hardware-aware tractable learning
Towards Hardware-Aware Tractable Learning of Probabilistic Models
Smart portable applications increasingly rely on edge computing due to privacy and latency concerns. But guaranteeing always-on functionality comes with two major challenges: heavily resource-constrained hardware; and dynamic application conditions. Probabilistic models present an ideal solution to these challenges: they are robust to missing data, allow for joint predictions and have small data needs. In addition, ongoing efforts in field of tractable learning have resulted in probabilistic models with strict inference efficiency guarantees. However, the current notions of tractability are often limited to model complexity, disregarding the hardware's specifications and constraints. We propose a novel resource-aware cost metric that takes into consideration the hardware's properties in determining whether the inference task can be efficiently deployed. We use this metric to evaluate the performance versus resource trade-off relevant to the application of interest, and we propose a strategy that selects the device-settings that can optimally meet users' requirements.
Towards Hardware-Aware Tractable Learning of Probabilistic Models
Smart portable applications increasingly rely on edge computing due to privacy and latency concerns. But guaranteeing always-on functionality comes with two major challenges: heavily resource-constrained hardware; and dynamic application conditions. Probabilistic models present an ideal solution to these challenges: they are robust to missing data, allow for joint predictions and have small data needs. In addition, ongoing efforts in field of tractable learning have resulted in probabilistic models with strict inference efficiency guarantees. However, the current notions of tractability are often limited to model complexity, disregarding the hardware's specifications and constraints.
Reviews: Towards Hardware-Aware Tractable Learning of Probabilistic Models
The authors propose a method to trade-off "computational costs" and "model fit" when learning a Sum-Product-Network (SPNs) represented as an Arithmetic Circuit. An SPN is a compact representation of a probabilistic model over discrete random variables with finite domain. The proposed method involves an SPN learner that is restricted to binary random variables. In practice, this requires to convert continuous variables into categoricals (e.g., using binning), and categoricals into binaries. While SPNs can handle missing data, they do are typically black-box models where the structure is learned.
Towards Hardware-Aware Tractable Learning of Probabilistic Models
Smart portable applications increasingly rely on edge computing due to privacy and latency concerns. But guaranteeing always-on functionality comes with two major challenges: heavily resource-constrained hardware; and dynamic application conditions. Probabilistic models present an ideal solution to these challenges: they are robust to missing data, allow for joint predictions and have small data needs. In addition, ongoing efforts in field of tractable learning have resulted in probabilistic models with strict inference efficiency guarantees. However, the current notions of tractability are often limited to model complexity, disregarding the hardware's specifications and constraints.
Towards Hardware-Aware Tractable Learning of Probabilistic Models
Olascoaga, Laura I. Galindez, Meert, Wannes, Shah, Nimish, Verhelst, Marian, Broeck, Guy Van den
Smart portable applications increasingly rely on edge computing due to privacy and latency concerns. But guaranteeing always-on functionality comes with two major challenges: heavily resource-constrained hardware; and dynamic application conditions. Probabilistic models present an ideal solution to these challenges: they are robust to missing data, allow for joint predictions and have small data needs. In addition, ongoing efforts in field of tractable learning have resulted in probabilistic models with strict inference efficiency guarantees. However, the current notions of tractability are often limited to model complexity, disregarding the hardware's specifications and constraints.